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Planar tilting maneuver of a spacecraft: singular arcs in the 
minimum time problem and chattering 

Jiamin Zhu* Emmanuel Trelat^ Max Cerfl 


Abstract 

In this paper, we study the minimum time planar tilting maneuver of a spacecraft, from 
the theoretical as well as from the numerical point of view, with a particular focus on the 
chattering phenomenon. We prove that there exist optimal chattering arcs when a singular 
junction occurs. Our study is based on the Pontryagin Maximum Principle and on results by 
M.I. Zelikin and V.F. Borisov. We give sufficient conditions on the initial values under which 
the optimal solutions do not contain any singular arc, and are bang-bang with a finite number 
of switchings. Moreover, we implement sub-optimal strategies by replacing the chattering 
control with a fixed number of piecewise constant controls. Numerical simulations illustrate 
our results. 


Keywords: spacecraft planar tilting maneuver; minimum time control; Pontryagin Maximum 
Principle; singular control; chattering arcs; sub-optimal strategy. 
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1 Introduction 

The minimum time planar tilting problem of a spacecraft consists of controlling the spacecraft, 
with certain prescribed terminal conditions on the attitude angles, accelerations, and the velocity 
direction, while minimizing the maneuver time and keeping constant the yaw and rotation angles. 
This problem is of interest for (at least) two reasons. The first one is that the resulting optimal 
strategy can be used during the rocket ascent phase, along which the attitude and the orbit 
motions are strongly coupled. The second one is that, as we will prove in this paper, the optimal 
trajectories, solutions of the problem, exhibit a chattering phenomenon which is, in itself, difficult 
and thus interesting to analyze, but which is also rather a bad news in view of practical issues. We 
thus analyze it in detail, providing sufficient conditions on the terminal conditions under which 
the optimal strategy does not involve any chattering, and in case chattering occurs, we provide 
alternative sub-optimal strategies. 

1.1 The optimal control problem 

Let us formulate the minimum time planar tilting maneuver problem (pitching movement of the 
spacecraft). Throughout the paper, we restrict our study to the planar case, in the sense that the 
spacecraft movement remains in a plane. 

Model. We assume that the Earth is a fixed ball in the inertial space, and that the velocity of 
the wind is zero. We consider an axial symmetric spacecraft (see Figure 1). Taking coordinates 
{x,y), we adopt the following notations: 

• Vx and Vy are the velocity components of the velocity vector v; 

• 9 is the pitch angle of the spacecraft; 

• a; is the angular velocity with respect to the Earth; 

• r > 0 is the distance between the spacecraft mass center Ob and the center O of the Earth; 

• £ > 0 is the distance from the thrust point P to the mass center of the spacecraft Ob', 

• Ca is the unit vector along the symmetric axis of the spacecraft, and e), is the unit vector 
perpendicular to Cq pointing to the North; 
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• / is the moment of inertia along the Ca x Cc axis; 

• fj, is the angle between the thrust vector T and the symmetric axis Cq of the spacecraft, and 
we must have 

• 7 is the flight path angle defined as the angle between the velocity v and the axis x. 




Figure 1: Frames and parameters in problem (MTTP). 

The motion of the spacecraft is controlled by the angle /i. Since ^ is small in practice (between 
±10 degrees), we assume that cos^ sa 1 and sinfi « Under this small angle assumption, the 
spacecraft evolves in time according to the system 

Vx = a cos 9 — cVxVy , 

Vy=asm9 + cvl-go, 

0 = UJ — CVxi 
dl = bu, 

with control u = —g/^max G [~li 1] a-nd a = Tjm, c=lfr,b = being positive constants. 

Actually, in our numerical simulations, we will use the parameters of Ariane 5 launchers (see 

Table 1). The modulus of the velocity v = ^Vx + Vy takes values in [0, Vm], and for the pitch angle 
and the angular velocity we have the estimate |0| ^ 9-max and |a;| ^ Wmax- 



a 

b 

c 

Vm {m/s) 

Wmax {rad/s) 

^inax('^Q'(i) 

Value 

12 

0.02 

1 X 10"“ 

5000 

0.3 

TT 


Table 1: System parameters. 


In the sequel, for convenience, we set xi = Vx, X 2 = Vy, x^ =9 and X 4 = uj. Denoting by 
X = {xi,X2,X3,X4), the system (1) can be written as the single-input control-affine system 


i = fo{x) ± ufi{x), 

where /o and fi are the smooth vector fields on defined by 

d d d 

fo = (acoscca - 0x4X2)-^: -h (asinxa ± cxj - go)^: -h {x4 - csi)- —, 

UX\ UX2 ^x^ 


fi=b 


8x4 


( 2 ) 


(3) 
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Terminal conditions. The requirements are the following: 

• all initial variables are fixed; 

• the final values of the variables 9 and uj are prescribed, and we require that, at the final time 
tf (which is let free), the velocity vector v{tf) be parallel to the spacecraft axis Caitf). 

It is indeed natural to consider v{tf) || ea{tf) as a terminal condition, because the spacecraft 
considered is of rocket-type, and such spacecrafts are usually planned to maintain a small angle 
of attack along the flight. Note that, here, the angle of attack is the angle between the spacecraft 
axis Co and the velocity v. The zero angle of attack condition ensures that the aerolift is null in 
order to avoid excessive loading of the structure (see [ 5 ]). 

Since 7 = arctan(x2/a:i) and v = \Jx\ -b a:|, we have 

7 = (a sin(a;3 — — go cos 7 )/v + cv cos 7, v = a cos(a;3 — 7) — 50 sin 7. ( 4 ) 

The final condition above is then written as 7(t/) = xsitj). In term of v and 7, the velocity 
components xi and X2 are xi = vcosj and X2 = usiny. We set u( 0 ) = vg and 7 ( 0 ) = 70. 

Minimum time planar tilting problem. Let xg G and let uq, 70, xgg, X4g and xgf be real 
numbers. In terms of the variables x = (xi, X2, xg, X4), the initial point is defined by 

^0 (^10 ; ^20 : ^30 ; ^ 4 o) ; 

with xig = vg COS70 and X2g = vg sin7o, and the final target is the submanifold of defined by 

Ml = {{xi,X2, Xg, X4) € I a:2 COSX3/ — Xg sinxgf = 0 , Xg = Xgf, X4 = 0 }. 

Throughout the paper, we consider the optimal control problem, denoted in short (MTTP), of 
steering the control system (1) from a;(0) = xg to the final target Mg in minimal time tf, under 
the control constraint u{t) G [—1,1]. 

1.2 State of the art 

The minimum time spacecraft attitude maneuver problem has been widely studied (see, e.g., 
[ 4 , 15 , 33 , 36 ]). Besides, there are many works on the coupled attitude orbit problem (see, e.g., 
[ 19 , 23 , 46 ]) and on the minimum time orbit transfer (see, e.g., [8, 10 , 22 , 42 , 48 ]). 

The problem (MTTP) under consideration in this paper is however more related to the well- 
known Markov-Dubins problem (in short, MD problem) and to variants of it. Indeed, if the system 
were to be directly controlled by the variable 2:3, then, by taking the target manifold to be a single 
point {x{tf) = Xf) and letting a = b = 1 , c = 0 , gg = 0 , the system ( 1 ) would be written as 


Xg = cos 2:3, ±2 = sin 2:3, 2:3 = u, 

and therefore, the problem (MTTP) coincides with the MD problem, which was first settled in 
[28] and was analyzed in detail by Dubins and many others (see, e.g., [14, 34, 39]). It has been 
shown that the optimal strategy for the MD problem consists in first reaching the singular arc 
with a single bang arc, then, in following this singular arc until one is sufficiently close to the final 
target, and finally, in leaving the singular arc in order to reach the target with a single bang arc. 
If we assume that gg 7 ^ 0, i.e., if we have the system 

Xg = COSX3, 2:2 = sin 2:3 — gg, Xg = u, 


4 



then the problem (MTTP) coincides with the Zermelo-Markov-Dubins problem (in short, ZMD 
problem) with constant wind field {wx,Wy) = {0,—go) (see, e.g., [2, 30, 31, 41]). The optimal 
strategy of this problem consists of a finite number of bang and singular arcs. Both the MD and 
the ZMD problems may involve a singular arc because the singular controls of these problems are 
of intrinsic order one (see further in the present paper for this notion). 

However, this is not the case for the problem (MTTP) for which the singular control is of 
intrinsic order two. In this sense, a problem closer to (MTTP) (with a = 6 = 1, c = 0, go = 0) is 
the Markov-Dubins problem with angular acceleration control (in short, MDPAAC) (see [26, 40]). 
In that problem, the model is a dynamic extension of the MD system, given by 

xi = cosxa, X 2 = sin 13 , X 3 = X 4 , ± 4 = u, 

The existence of a chattering phenomenon for MDPAAC was first put in evidence in [40]. Although 
the optimality status of these chattering arcs remains unclear, the discussion of the chattering 
phenomenon brings interesting issues for the analysis of the present problem (MTTP). 

The system we consider here can also be seen as a variation of the MD system, with nonconstant 
wind and controlled by the inertial control. Thus, we expect the solution of the problem (MTTP) 
to share properties similar to MDPAAC (in particular, chattering), MD and ZMD (in view of the 
global behavior of the solution). 

In fact, using [49], we will be able to prove the existence and the optimality of the chattering 
phenomenon in the problem (MTTP). The chattering phenomenon (also occuring in MDPAAC) 
is caused by singular controls of intrinsic order two. It makes the optimal synthesis for the problem 
(MTTP) essentially different from that of the MD or ZMD problem. 

However, in some sense the optimal solution of problem (MTTP) consists as well of three 
pieces: the first piece consists of bang arcs to reach the singular arc, the second piece is a singular 
arc, and the third piece consists of a succession of bang arcs finally reaching the target submanifold. 

Since the chattering phenomenon causes difficulties in practical use, we will also provide suffi¬ 
cient conditions on the terminal conditions, under which the chattering arcs do not appear in the 
optimal solution. This prediction result will be useful in order to decide which numerical method 
(either direct, or indirect, or sub-optimal) is the most appropriate. 

1.3 Chattering phenomenon 

Let us recall that we speak of a chattering phenomenon (sometimes also called a Fuller’s phe¬ 
nomenon), when the optimal control switchings an infinite number of times over a compact time 
interval. It is well known that, if the optimal trajectory of a given optimal control problem involves 
a singular arc of higher order, then no connection with a bang arc is possible and then bang arcs 
asymptotically joining the singular arc must chatter. On Figure 2(b), the control is singular over 
(h,0), and the control u{t) with t € {ti — ei,ti) U (0,0 + £ 2 ), ei > 0, £2 > 0 is chattering. The 
corresponding optimal trajectory is called a chattering trajectory. On Figure 2(a), the chattering 
trajectory “oscillates” around the singular part and finally “gets off’ the singular trajectory with 
an infinite number of switchings. 

In this paper, we call singular junction, the junction point between a singular arc and a non¬ 
singular arc. 

To better explain the chattering phenomenon, we recall the well-known Fuller problem (see 
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Figure 2: An illustration of chattering phenomenon. 


[17, 27]), which is the optimal control problem 
min / dt, 

Jo 

il{t) = X 2 {t), X 2 {t) = u{t), \u{t)\ < 1, 

a;i(0) = xio, X 2 { 0 ) = X 20 , = 0, X 2 {tf) = 0, tf free. 

1^2 

We dehne ^ as the unique positive root of the equation + ^^/12 — 1/18 = 0, and 

we define the sets 

r+ = {{xi,X2) e I a:i = ^x\, X2 < 0}, R+ = {{xi,X2) G | Xi < -sign(a;2)^a:l}, 
r_ = {{xi,X 2 ) G I = -ix\, X 2 > 0}, R- = {{xi,X 2 ) G R^ I xi > -sign(x 2 )Ca: 2 }- 

Then the optimal synthesis of the Fuller problem is the following (see [18, 35, 47]). The optimal 
control is given in feedback form by 

1 if a; G R+ IJ r+, 

-1 iixGR-[jT_. 

The control switchings from u = 1 to m = —1 at points on r_ and from u = —1 to m = 1 at 
points on r+. The corresponding trajectories crossing the switching curves r± transversally are 
chattering arcs with an infinite number of switchings that accumulate with a geometric progression 
at the final time tf > 0. 

The optimal synthesis for the Fuller problem is drawn on Figure 3. The solutions of the Fuller 
problem are chattering solutions since they switch transversally on the switching curves F± until 
finally reaching the target point on the singular surface defined by the union of all singular solutions. 

In fact, the optimal control of the Fuller problem, denoted as u*, contains a countable set of 
switchings of the form 

1 if t G [t2k, t2k+l), 

— 1 if t G [t2/c+l, i2fc+2], 

where {tfcjfeeN is a set of switching times that satisfies (ti +2 — U+i) < (^z+i — U), * G N and 
converges to tf < + 00 . This means that the chattering arcs contain an infinite number of switchings 
within a finite time interval tf > 0 . 
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Figure 3: Optimal synthesis for the Fuller problem. 


The analysis of chattering arcs is challenging. Based on a careful analysis of the Fuller problem, 
M.I. Zelikin and V.F. Borisov obtained a geometric portrait of solutions in the vicinity of the second 
order singular solutions (see [49, 50]). These solutions are called chattering solutions. Using their 
results, we will be able to prove rigorously the existence and optimality of chattering solutions in 
our problem (MTTP). 

The basic idea of their approach to provide sufficient conditions for optimality is based on the 
following well-known sufficient optimality condition: 

Let M be a smooth manifold of dimension n, and let T*M be its cotangent bundle, 
endowed with its canonical symplectic structure. If a submanifold L ofT*M generated 
by a given Hamiltonian system on T*M is Lagrangian, then a “nice” regular projection 
of trajectories of L onto M can also be seen, by canonical injection, as a Lagrangian 
submanifold of T*M, and the trajectories are locally optimal in (7° topology. 

Recall that a submanifold L of a smooth manifold M is said to be Lagrangian ii f^pdx = 0 for 
every piecewise smooth closed contour 7 on the manifold. Hence, the manifold consisting of the 
solutions of a Hamiltonian system with transversality condition {pdx = 0 on the target manifold) 
is Lagrangian. Denote the cost functional to be minimized as C(-, •). A trajectory x(-) is said to be 
locally optimal in (7° topology if, for every neighborhood V of x{-) in the state space, for every real 
number rj so that |r;| ^ e, for every trajectory x{j, associated to a control v on [0, T + rj], contained 
in W, and satisfying a;(0) = a;(0) = xq, x(T + r]) = x[T), there holds C{T + r],v) ^ C{T, u). 

Hence, the problem of proving the local optimality of a solution comes down to constructing 
a Lagrangian submanifold. The usual way to construct a Lagrangian submanifold is to integrate 
backward in time the Hamiltonian system from the target point. However, this is not applicable 
for the chattering arcs because the control is not anymore piecewise constant and the length of 
switching intervals goes to zero at the singular junction. 

In order to overcome this flaw of the usual approach, M.I. Zelikin and V.F. Borisov proposed 
an explicit procedure to construct Lagrangian submanifolds filled by chattering trajectories. The 
main difficulty of this construction procedure is to analyze the regularity of the projections of the 
extremal lifts to the state space. 
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When using numerical methods to solve an optimal control problem, the occurrence of chat¬ 
tering arcs may be an obstacle to convergence. Recall that there are two main types of numerical 
methods for solving optimal control problems: indirect methods and direct methods (see, e.g., the 
survey paper [43]). 

The direct methods (see [3]) consist of discretizing the state and the control and thus of reducing 
the problem to a nonlinear optimization problem (nonlinear programming) with constraints. Using 
standard optimization routines, it is then possible to make converge the algorithm for the Fuller 
problem. Of course, the numerical solution which is obtained can only have a finite number of 
switchings, because in the approximation scheme, the chattering control is actually approximated 
with a piecewise constant control. 

The indirect methods consist of numerically solving a boundary value problem obtained by 
applying the Pontryagin Maximum Principle, by means of a shooting method. An indirect method 
is also called a shooting method (see [38]). In [6], it is shown that the presence of chattering 
arcs may imply ill-posedness (non-invertible Jacobian) of shooting methods for single-input prob¬ 
lems. According to [50], the difficulty is due to the numerical integration of the discontinuous 
Hamiltonian system (i.e., the right-hand side of the Hamiltonian system is discontinuous) because 
the chattering solutions worsen the approximation and error estimates during calculation for the 
standard numerical integration methods. 

1.4 Structure of the paper 

The paper is structured as follows. 

In Sections 2.1 and 2.2, the Pontryagin Maximum Principle (PMP) and an usual way to compute 
singular controls are recalled. Section 2.3 is devoted to recall some results of [49, 50], explaining ge¬ 
ometric features of the chattering phenomenon, based on a semi-canonical form of the Hamiltonian 
system along singular extremals of order two, with the objective of showing how these theoretical 
results can be applied in practice. 

The non-singular (bang-bang) extremals of (MTTP) are analyzed in Section 3.1, and the 
Lie bracket configuration is given in 3.2. We prove in Section 3.3 that the singular controls for 
(MTTP) are of intrinsic order two, which implies the existence of chattering arcs. Based on the 
results of M.I. Zelikin and V.F. Borisov, we prove in Section 3.4 that the optimal chattering arcs 
of the problem (MTTP) are locally optimal in (7° topology. 

In Section 4, we provide, for the cases with c = 0 and c > 0 respectively, sufficient conditions 
on the initial values under which the optimal solutions do not contain any singular arc, and do not 
chatter. Numerical simulations, in Section 5.1, illustrate these conditions. 

Since chattering is not desirable in view of practical issues, we propose some sub-optimal 
strategies in Section 5.2, by approximating the chattering control with piecewise constant controls. 
Our numerical results provide evidence of the convergence of sub-optimal solutions to optimal 
solutions (but this convergence is not analyzed from the theoretical point of view in the present 
paper). 

2 Geometric analysis of chattering 

Let M be a smooth manifold of dimension n, and let Mi be a submanifold of M. We consider on 
M the minimal time control problem 


mint/, 

x{t) = h{x{t)) + u{t)fi{x{t)), |u(t)l ^ 1, 
a;(0) = xq, x{tf) S Ml, 1/ ^ 0 free, 


( 5 ) 


where /o and fi are two smooth vector fields on M. Since the system and the instantaneous cost 
are control-afhne, and the control constraint is compact and convex, according to classical results 
(see, e.g., [12, 44]), there exists at least one optimal solution (a;(-),«(•)), defined on [0,t/]. 


2.1 Application of the Pontryagin maximum principle 

According to the Pontryagin maximum principle (in short, PMP, see [32]), there must exist an 
absolutely continuous mapping p(-) defined on [0,</] (called adjoint vector), such that p(t) G 
for every t G [0,t/], and a real number ^ 0, with (p(-),p°) ^ 0, such that 



( 6 ) 


(7) 


is the Hamiltonian of the optimal control problem (5), and (the final time tf being free) 



( 8 ) 


almost everywhere on [0,t/]. Moreover, we have the transversality condition 

P{tf) -L 


(9) 


where denotes the tangent space to Mi at the point x{tf). 

The quadruple (a::(-),p(-),p°, «(•)) is called the extremal lift of x{-). An extremal is said to be 


normal (resp., abnormal) if < 0 (resp., p® = 0). 
We define the functions 


hoix,p) = {p,fo{x)), hi{x,p) =—{x,p,p°,u) = {p,fi{x)). (10) 


( 10 ) 


It follows from (8) that u{t) = sign((p(t)), whenever p(t) = hi{x{t),p{t)) ^ 0. For this reason, the 
function ip is also called the switching function. 


Bang arcs. We say that the trajectory x{-) restricted to a sub-interval I of [0,t/] is a bang arc 


if u{t) is constant along /, equal either to -1-1 or to —1. We say that the trajectory is bang-bang 
on [0,tf] if it is the concatenation of bang arcs. 

Singular arcs. If p(t) = hi{x{t),p{t)) = 0 along a sub-interval I of [0,t/], then the relation (8) 
does not allow to directly infer the control, and in that case we speak of a singular arc, or of a 
singular extremal. 

Equivalently, a singular control is defined as follows. The end-point mapping E : K" x R x 
L°“(0,-boo; R) —R" of the system is defined by E{xo,tf,u) = x{xo,tf,u) where t x{xo,t,u) is 
the trajectory solution of the control system, corresponding to the control u, such that x{xo,0, u) = 
xq (the domain of definition is then the set of controls for which the trajetory is indeed globally 
defined on [0,f/j). A trajectory x(-), defined on [0,t/], with a;(0) = xq, associated with a control 
u, is said to be singular if the differential duE(xo,tf,u) is not of full rank. Accordingly, we speak 
of a singular control. It is well known that a trajectory x(-) is singular on [0,tf] if and only if it 
has an extremal lift (x(-),p(-),p°, tt(-)), satisfying (6) and hi{x{t),p{t)) = 0 on [0,t/] (see [7, 44]). 
This extremal lift is called a singular extremal. 
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2.2 Computation of singular arcs 

In order to compute a singular control, the usual method (see [7]) consists of differentiating re¬ 
peatedly the relation 

ip(t) = hi{x(t),p{t)) = 0 (11) 

with respect to time, until the control appears in a nontrivial way. Using the Hamiltonian system 
(6), such derivations are done thanks to Poisson brackets and Lie brackets. By differentiating (11) 
a first time (along the interval I), we obtain 

0 = ip{t) = {hQ,hi}{x{t),p{t)) = {p{t),[foJi]{x{t))), (12) 

which is a new constraint. Differentiating a second time, we obtain 

0 = (p{t) = {ho, {ho, hi}{x{t),p{t)) + u{t){hi, {ho, hi}{x{t),p{t)) 

= (p{t),[fodfoJi]ixit))) + u{t){p{t),[fi,[fo, fi]{x{t))), 

in which the control now appears in a nontrivial way provided that {hi, {ho, hi}}(x{t),p{t)) < 0. 
The latter condition is known as strengthened Legendre-Clebsch condition. Under this condition, 
we can indeed compute the singular control as 

^ {ho,{ho,hi}}[x{t),p{t)) 

{hi,{ho,hi}}[x(t),p{t)y 

It can be noted that the hrst derivative of (/?(•) does not make appear the control. Hence, two 
derivations in time are at least necessary in order to make appear the control in a nontrivial 
way. Such controls are also said to be of minimal order, and actually this property is generic (see 
[11, 13]). Hereafter, due to the fact that optimal singular arcs have to appear with an even number 
of derivations, we also say that such singular arcs are of intrinsic order one. 

If {hi,{ho,hi}}{x{t),p{t)) = 0 identically on I, then the above computation does not suffice 
and we need to differentiate more. In that case, we see that we have two additional constraints: 

{ho,{ho,hi}}{x{t),p{t)) = {p{t),[fo,[foJi]Kx{t))) =0, (13) 

and 

{hi, {ho, hi}}{x{t),pit)) = (pit), [fi, [fo, fi]]ixit)) = 0, 

for every t G I. 

Let us recall the concept of the order of a singular control. Roughly speaking, it is the hrst 
integer m such that the control u appears in a nontrivial way in the (2m)*^-derivative of the 
switching function (^(•) (see [35, 50]). 

Definition 1. The singular control u (along the sub-interval I) is said to be of local order k if the 
conditions 


^V3W(x(t),p(t)) = 0, * = 0,1,--- ,2fe-1, ■^ip^^^\xit),pit)) yO, 

hold along the sub-interval I. If moreover the Lie brackets [fi, [ad*/o-/i]], f = 0, • • • , 2fe — 2, are 
identically equal to zero (over the whole space), then the singular control u is said to be of intrinsic 
order k. 

We adopt the usual notations ad/g./i = [/oj/i] (resp., ad/ig./ii = {^Oj^i}) and ad*/o-/i = 
[/o,ad*“Vo-/i] (resp., ad^/iQ./ii = {ho,ad*“^ho.hi}). 
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Remark 1. If a singular control u is of local order two, then the conditions (along I) 



{p{t), [/i,ad/o./i](a;(t))) = 0, 


and 

= 2(p(t), [/i,adVo-/i](a;(t))) +u{t){p{t), [fi, [/i,ad/o./r]](a:(t))) = 0, 

are additional constraints that must be satisfied along the singular arc. In contrast, if u is 
of intrinsic order two, then these conditions are trivially satisfied since [/i,ad/o./r] = 0 and 
[/i, ad^/o./i] = 0. In the present paper, we are in the situation of singular arcs of intrinsic order 
two, and we will then focus on that case. 

Actually, we did not consider, in the above definition, the case where the first nonzero derivative 
is of odd order. Indeed, such singular controls are actually never optimal, and hence we do not 
consider them in our analysis. This fact is due to the following well-known result, usually referred 
to as Kelley’s condition for singular extremals of local order k (see [21, 24]): 

If a trajectory x{-), associated with a singular control u{-), is locally time-optimal on 
[0,tf] in L°° topology, then the generalized Legendre-Clebsch condition 


i-iy 


d d^^hi 
du dt"^^ 


^ 0 , 


is satisfied along the extremal. Reeall that a trajectory x{-) is said to be locally optimal in 
L°° topology if, for every neighborhood V of u in i°°([0, T -|-e], U), for every real number 
rj so that \r]\ ^ e, for every control v GV satisfying E{xq,T -\-ri,v) = E(xq,T,u) there 
holds C{T -\- rj,v) C(T, u), where E : R" x R x T°°(0, -l-oo; R) R" is the end-point 
mapping defined by E(xo,tf,u) = x{xo,tf,u). 

Therefore, the generalized Legendre-Clebsch condition for a singular control of local order 2 is 


{pit), [/i,adVo-/i](a:(t)) + [fo, [fo, [fi, [/o,/i]]]](a:(t)) + [fo, [/i, adVo-/i]](a:(t))) < 0, 


and if the singular control of intrinsic order 2, then this condition takes the simpler form 

{pit), [/i,adVo-/i](a:(t))) ^ 0. 


Turning back to the previous computation, if the singular control is of intrinsic order two, then 
by differentiating ip{t) = {ho, {ho, hi}}ix{t),pit)), we get 

0 = ip‘'^\t) = {ho,a.(i^ho.hi}ix{t),pit)) + M(t){/ii, ad^Iio-^i}(a:(t),p(<)) 

= {pit), [/o,adVo-/i](a:(t))) Euit){pit), [/i,ad^/o./i](x(t))), 

which, using the fact that [/i, ad^/o./i] = 0, leads to the additional constraint 

{ho,&d?ho.hi}ixit),pit)) = (p(t), [/o,adVo-/i](a:(<))) =0- (14) 

Differentiating again, we get 

0 = (f‘'‘^\t) = {ho,ad^ho.hi}ixit),pit)) -\- uit){hi, ad^ho.hi}ixit),pit)) 

= {pit), [fo,ad^fo.fi]ix{t))) -\-uit){pit), [/i,ad^/o./i](x(t))). 
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(15) 


By definition, we have (p(t), [/i, ad/p ./i](a;(t))) ^ 0, and thus the singular control is 


a.d^hQ.hi{x{t),p{t)) 

{hi,aA^hQ.hi}{x{t),p{t)y 


which is smooth. 

Remark 2. Along such a singular arc of intrinsic order two, the singular control is given by (15) 
and the constraints (11), (12), (13), (14) must be satisfied along the arc. 

In this paper, we are actually concerned with optimal singular trajectories of intrinsic order 
two, which cause the occurrence of a chattering phenomenon in our problem. Let us recall the 
following result (see [21, 29, 49]). 

Lemma 1. We assume that the optimal solution x(-) of the optimal control problem (5) involves 
a singular arc (on a sub-interval I) of intrinsic order two, for which the strengthened generalized 
Legendre-Clebsch condition 


= {hi,ad^ho.hi}(x(t),p(t)) < 0 

holds true along an extremal lift. If we have |u(t)| < 1 along the singular arc, then the singular arc 
cannot be matched directly with any bang arc. In particular, if I is a proper subset of[0,tf], then the 
optimal solution chatters, in the sense that there is an infinite number of bang arcs accumulating 
at the junction with the singular arc. 

Although this result is known, we will provide a short proof of it when analyzing our spacecraft 
problem in Section 3.3. 

Remark 3. Note that the Fuller problem can be adapted to fit in the framework above, although 
this is not a minimum time problem. Actually, it suffices to add the objective as a third state 
variable X 3 , evolving according to is = Xi/2, and then the Fuller problem can be interpreted, by 
uniqueness of the solution, as a minimum time problem with the vector fields fo{x) = {x 2 , 0, Xi/ 2 )^ 
and fi = (0,1,0)^. The corresponding singular extremal is therefore given \yy u = Q, xi = X 2 = 
Pi = P 2 = = 0 and P 3 < 0 being constant. The solutions of the Fuller problem are optimal 

abnormal extremals for this three-dimensional problem. Moreover, it is easy to see that u = 0 is a 
singular control of intrinsic order two, along which the strengthened generalized Legendre-Clebsch 
condition is satisfied (pa < 0). Then Lemma 1 can be applied. 

2.3 Geometric analysis of the chattering phenomenon 

In this section, we recall some results on chattering solutions established in [49, 50]. Since these 
references are not always easy to read, our objective is also to provide a more pedagogical exposition 
of these results and to show how they can be used in practice. 

Recall that a chattering solution is the optimal solution corresponding to the chattering control 
which switches an infinite number of times over a compact time interval. 

2.3.1 Semi-canonical form 

The semi-canonical form (see [25, 49]) is a way of writing the Hamiltonian system (6) in a neigh¬ 
borhood of its singular arcs, which will be used later to analyze the solutions near (in topology) 
singular arcs of intrinsic or local order two. The main idea is to design a variable change that leads 
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to a form involving the switching function and its derivatives directly as variables. This makes the 
analysis of the extremals near the singular arcs more convenient. 

Let x{-) be an optimal trajectory of (5) on and let {x{-),p{-),p^,u{-)) be an extremal 

lift (coming from the PMP). We assume that x{-) involves a singular arc of intrinsic second order 
two, along the sub-interval I, satisfying the strengthened generalized Legendre-Clebsch condition. 

The Hamiltonian (7) can be rewritten as H = Hq + uhi -l-p°, with and hi defined by (10). 
We assume that 

dimSpan{/i,ad/o./i,adVo-/i,ad^/o./i} = 4. (16) 

We define the new coordinates 

Zi = hi, Z 2 = h^i'^ = {ho,hi}, Z 3 = h^^^ = ad^hij.hi, Z 4 = h^i^ = ad^ho.hi, (17) 

and using that [/i, [fo,fi]] =0 and that {hi, ad^ho.hi} < 0 along I, we have 

= 22 , i2 = Z 3 , Z 3 = Z 4 , Z 4 = a{x,p) + ul3{x,p), 

where a = ad^/ip./ii and (3 = {hi, ad^ho.hi} < 0. 

Note that zi is chosen as the switching function = hi{x{t),p{t)) and Zi is chosen as the 
(i — l)-th derivative of the switching function. In fact, using that [fi, [fo, /i]] = 0 and using Jacobi’s 
identity, we have 

(hi, {ho, {ho, hi}}} = —{ho, {{ho, hi}, hi}} — {{ho, hi}, {hi, ho}} = {ho, {hi, {ho, hi}}} = 0. 


This, together with /3 < 0, indicates that the singular control considered here is of intrinsic order 
two and satisfies the generalized Legendre-Clebsch condition. By definition, we have Zi = 0, 
i = 1, 2, 3,4, along snch a singular arc. 

From (16), we infer that zi, Z2, Z3, Z4 are functionally independent in the neighborhood of the ex¬ 
tremal lift {x{-),p{-)), along [0, t/]. We complement z = (zi, Z2, Z3, Z4) with w = (wi, ■ ■ ■ , W 2 n- 4 ) S 
]^2n-4 Jacobi matrix of the mapping (x,p) >->■ (z,w) is nondegenerate, i.e.. 


det 


/ D(z,w) \ 
\D{x,p) j 


^ 0 , 


along the extremal. Since our point of view is local, we assume that (x,p) and {z,w) live in 
The Hamiltonian system (6) can be rewritten, locally along the extremal, as 


Zi = Z2, Z2 = Z3, Z3 = Z4, Z4 = a{z,w) + ul3{z,w), w = F{z,w,u), (18) 


and the extremal control is given by 

fl if zi(t) > 0, 

u{t)=}-a//3 ifzi(t)=0, 

[—1 if zi(t) < 0. 

Accordingly, we define the singular surface (smooth manifold consisting of singular extremals of 
second order) as 

5 = {(z, la) I (zi, Z2, Z3, Z4) = (0,0, 0,0)}, 

and the switching surface as 

P = {(z,ii;) I zi = 0}. 
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If a trajectory z{-) is a solution of (18), then a straightforward calculation yields that zx = 
G\{z{t/\)) is also a solution of (18), for any number A > 0, where 

Ga(*-(()) = (aC-, (1) ,A>,. (() .A^^, (() ,A,4 , (19) 

This is an important property for the Fuller problem (self-similar solutions). 

The system (18) is useful in order to analyze the qualitative behavior of solutions near the 
singular surface consisting of singular extremals of intrinsic order two. To include some Hamiltonian 
systems having singular arcs of local order two, we consider a small perturbation of the system 
(18) in the neighborhood of a given point (0,wo) G S', given by 

Z'l = 22 + fl{z,W,u), 

Z2 = 23 + f2{z,W,u), 

< £3 = Zi + f 3 {z,w,u), ( 20 ) 

24 = a{w) -I- m/ 3 (w) -b f4{z, w, u), 
w = F{z,w,u), 

with f,{z,w,u) = o{zi+i), i.e., 

lim A“*^^“*^|/i(GA( 2 (t/A)), w,m)| <-boo, i = l,2,3,4. (21) 

A-). 0 + 

The system (20)-(21) is called a semi-canonical form. 

Remark 4. The variables ( 2 , w) can be chosen differently from (17) in order to get a simpler local 
system (20). This is why this form is called semi-canonical, and not canonical. Moreover, this 
change of variable is not unique. 

2.3.2 Geometry of chattering extremals 

The first result concerns the existence of chattering solutions. In contrast to Lemma 1, this result 
can also be applied to the case of singular arcs of local order two, and it describes the phase portrait 
of optimal extremals in the vicinity of a manifold of singular arcs of order two. 

Recall that the singular surface S for the system (20) is of codimension 4. The surface S satisfies 
four constraints 21 = 0 , 22 = 0 , 23 = 0 , 24 = 0 corresponding respectively to null derivatives of 
the switching functions i = 0,1,2, 3. Considering a point (0,wo) G S, if Piwo) < 0 and 
|a(r/;o)| < —f3(wo), there exists a neighborhood of this point in which the singular extremals 
passing through it satisfy the generalized Legendre-Clebsch condition and the singular control 
|u| = I — a{w)/j3{w)\ < 1 is admissible. The following proposition indicates that, for any point 
in such a neighborhood, there exists a family of chattering extremals coming into this point, and 
there is another family of chattering extremals emanating from this point. Note that a family of 
chattering extremals is a one-parameter family, with the parameter A defined in (19). 

Proposition 1 (Bundles with chattering fibers). Consider the system (20), in an open neigh¬ 
borhood of the point (0,?no)- If l3{,wo) < 0 and |a(mo)| < then there exists an open 

neighborhood O of wq in such that, for any w € O, there are two one-parameter families of 

chattering extremals intersecting only at the point ( 0 ,r(;). 

The extremals of the families fill two manifolds Afff and Af~, each of them being of dimension 
2 and homeomorphic to coming respectively into and out of the point (O,?/;). The switching 
points of J\fi^ fill two piecewise-smooth curves Tj);. 

The union of all those submanifolds is endowed with the bundle structure with base 

O and two-dimensional piecewise smooth fibers filled by chattering extremals. 
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Figure 4: Phase portrait of optimal extremals near the singular surface. 


Figure 4 illustrates Proposition 1. The extremals living in the submanifolds and J\f~ are 
chattering. More precisely, the extremals in reach (0, w) (in finite time) with infinitely many 
switchings, and the extremals in leave (0, w) with infinitely many switchings. The submanifolds 
can be seen as two-dimensional fibers. 

Proof. The complete proof of Proposition 1 is done in [49]. Let us however sketch the main steps. 
Assume that Z 2 > 0. 

1. Prove that there exist self-similar solutions (i.e., the one-parameter family of chattering 
solutions) for the unperturbed system (18) using the Poincare mapping $ of the switching 
surface to itself. 

2. Prove that the points on S are the stable points of $ o $, by calculating the eigenvalues of 
d(4> o $)(0, icq)- Applying the invariant manifold theorem, there exists a one-dimensional 
$ o 4>-invariant submanifold transversal to S and passing through the point (0,tyo)- The 
restriction of $ o $ to this submanifold is a contracting mapping. It follows the existence of 
a two-dimensional manifold in the (z, w)-space, filled by chattering extremals entering 
into (0,wo)- Moreover, the smooth dependence theorem leads to the bundle structure of 

^Wo-^Wo ■ 

3. Prove that for the small perturbation system (20), the Poincare mapping $ is well dehned 
and smooth at the points in the neighborhood of ■ Using similar techniques as in the first 
and second steps, prove that the solutions of the perturbed system have the same structure 
than that of the unperturbed system. 

When Z 2 < 0, another two-dimensional manifold in (z, ii;)-space filled by chattering extremals 
that coming out of the point (0,r(;o) can be found and Uwo-^wg is also endowed with a bundle 
structure. □ 

The subbundles described in Proposition 1 are given by 

where the subbundle E“*" (resp., E“) is filled by chattering arcs that come into (resp., come out 
of) the singular surface. Moreover, we denote the switching surfaces as F^ = Uu, 

Note that it suffices to consider only the subbundle £■*■, since the properties of can be 
obtained similarly. We consider the canonical projection tt : E+ —O from the subbundle to the 
base. 
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2.3.3 Optimality status 


We now raise the question of knowing whether these chattering extremals are optimal or not. Let 
us consider again the Fuller problem to give an intuitive idea. Using (17), we choose the new 
variables 2 = (p 2 , —2xi, — 2 x 2 ) and then clearly the singular surface coincides with the origin. 

According to Proposition 1, there are two integral submanifolds of dimension 2 that are filled by 
chattering extremals coming into and out of the origin within hnite time, with infinitely many 
switchings. 

We consider the canonical projection tt* : (z, w) —>■ x from the (z, icj-space to the x-space (state 
space). It is known that the extremals fill a Lagrangian submanifold in the (z,w)-space. Their 
projection on the state space are the trajectories, of which we would like to ensure their local 
optimality status. According to the conjugate point theory (see [1, 9]), it suffices to ensure that 
the projection tt* be regular along the Lagrangian manifold (in other words, we require that its 
differential be surjective along that manifold). Note that we can consider as well the projection 
from the (x,p)-space to the x-space, instead of tt*, because the coordinate change (x,p) i—>■ {z,w) 
is bijective in the neighborhood of a point {x,p) G S. Indeed, this coordinate only needs to be 
regular for providing the regularity of projection from (x,p)-space to x-space. 

As illustrated on Figure 5(a), the above regularity condition ensures that the trajectories in 
the x-space do not intersect each other before reaching the target point or submanifold, and 
thus ensures to avoid the loss of local optimality of the trajectories at the intersection point 
(i.e., the conjugate point). Figures 5(b) and 5(c) show the optimal synthesis of the chattering 
trajectories tt* {Af ^) and tt* (A/"“ ) for the Fuller problem, respectively. These chattering solutions 
do not intersect and they are locally optimal. 



Figure 5: (a) Illustration of sufficient optimality condition; (b)-(c) Optimal synthesis of the Fuller 
problem. 

Let Ml be a a target submanifold contained in the projection of the singular surface MS. For 
any point x S Mi, we define its lift (x,p(x)) satisfying (x,p(x)) G S, H{x,p{x)) = 0 andp(x) dx = 0 
(transversality condition). The union N of all such points (x,p(x)) must be transversal to the flow 
of the singular extremals in S. Thus, the singular extremals reaching the submanifold iV fill a 
submanifold N*. In short, the submanifold TV is a lift of the target Mi that intersects with the 
singular extremals. 

It is easy to see that the submanifold N* is Lagrangian. Hence the subbundle 7r“^(A^*) is 
Lagrangian as well. Therefore, according to the theory on Lagrangian manifolds and sufficient 
optimality conditions, it suffices to check the regularity of the projection tt* restricted to 7r“^(A^*). 
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The following proposition provides sufficient optimality conditions (see [50]) when the subman¬ 
ifolds N and N* are of dimension n — 3 and n — 2 respectively. 

Proposition 2. Consider the subbundle Tr~^(N*) of the bundle E’*'. Assume that the restriction 
of the projeetion tt* on any smooth part of the bundle Tr~^{N*) is regular and can be regularly 
extended to boundary points of the smooth part. Assume that the target manifold Mi is eonneeted. 
Then the projection of the solutions of the system (20) filling are locally optimal in 

topology. 

The target submanifold has to be chosen adequately and must be of order n — 3 in order to use 
this proposition. This condition on the dimension is used to take into account the two-dimensional 
fibers mentioned in Proposition 1. 




Figure 6: Illustration of Proposition 2. 

As shown in Figure 6, due to the endowed bundle structure, for every given initial point (^o, '*^o) 
in the neighborhood of the singular surface S in (z, ty)-space, there is a neighborhood V of the 
point {zq,wo) such that all extremals starting from the points inside V reach a point on N* in 
finite time with infinitely many switchings. Then, these extremals reach the target manifold N 
along the singular extremals in N*. If the projection tt* is regular, then the projected trajectories 
in the x-space are locally optimal in (7° topology. 

The condition of being a regular projection is the most difficult one to check. We set 

E* = 7r-i(Af*), r* = E*nr+, So = sn{H = o}. 

In [50], the authors provide the following sufficient condition for having a regular projection of E* 
into the cc-space. 

Lemma 2. Let C be spanned by the veetor djdzj, and by the veetors of the tangent plane to the 
switching surface F*. Assume that the restriction of dir* to C is surjective. Then, the restriction 
of TT* to E* is regular as well. 

Remark 5. Lemma 2 indicates that dir.-^ should be transversal to the tangent plane to the 
switching surface of the chattering family generated by the submanifold N. Note that, at the 
points of the curve N, the tangent plane of the switching surface F* consists of three types of 
vectors: the nonsingular velocity vector, the singular velocity vector and the tangent vector to the 
curve N. 


3 Application to the planar tilting maneuver problem 

In this section, we analyze the bang-bang, singular and chattering extremals of the problem 
(MTTP). We will see that, when the strategy involves a singular arc, then this singular arc is of 
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intrinsic order two, and according to the previous section, this causes a chattering phenomenon. 
We will prove that chattering extremals are locally optimal in C° topology. 


3.1 Extremal equations 

The Hamiltonian of the problem (MTTP) is of the form H = ho + uhi +p°, where ho = {p, fo{x)) 
and hi = (p, fi{x)) = bp 4 , and the adjoint vector p = (pi,p 2 ,P 3 ,P 4 ) satisfies the adjoint equations 

{ Pi = c{piX2 - 2p2Xi +P 3 ), 

P 2 =cpixi, ^ 22 ) 

P3 = a(pismx3 - P2COSX3), 

Pi = -P3- 


Since 6 > 0, we infer from the maximization condition of the PMP that u{t) = sign(p 4 (t)), provided 
that ip{t) = hp/iit) 7 ^ 0 (bang arcs). The final condition x{tf) € Mi yields the transversality 
condition 

Pi(t/)cos( 7 /)+P 2 (i/)sin( 7 /) = 0 . 


3.2 Lie bracket configuration of the system 

Before proceeding with the analysis of singular extremals, it is very useful to compute the Lie 
brackets of the vector fields /o and fi defined by (3). This is what we call the Lie bracket 
configuration of the control system ( 2 ). 


Lemma 3. We have 


fo 


(a cos X 3 


s L/ . , 2 

cxiX2)-;i -1- (asmxa + cx^ 

uXi 


h 



[fo, [fo, /l]] 


[/o, fl] 



, . 9 , d 

—ab sm X 3 — -h ab cos X 3 —— 

UXi UX 2 





[fl, [fo, /i]] = 0 , 


adVo./i 


—ab((x 4 — 2 cxi) COSX 3 + CX 2 sinxa)-;-— 

UXl 


ab sinX 3 (x 4 — 3cxi )—— 
0 x 2 


abc sin 3 : 3 ——, 

0 X 3 


[fl, [fo, [fo, fl]] —[fo, [fl, [fo, fl]] — [fl, [fl, [fo, fl]] — 0 , 

ad^/o./i =ab{{—4:CXiX4 + ego + x\-\- 4:C^x\ — 0 ^X 2 ) sinxs — 2ac + 4accos^ 0:3 + (cxi 

d 

— 2 x 4 )cx 2 cos 3 : 3 )—- h ab{—c^X 1 X 2 sinx 3 + 4 acsinx 3 COSX 3 + (—X 4 + 60 x 1 X 4 


9xi 
d 


d 


— 7c^Xi) cosx 3 )-^-h a6c(3cxi COSX3 — 2 x 4 COSX3 — 0 x 2 sinxs)-^ — 


dx 

[/i,ad^/o./i] = - a 6 ^cosx 3 -^-a 6 ^sinx 3 ^. 

UX\ UX2 


9X3 


and 


dimSpan(/i, [/o,/i], [fo, [fo, [/o,/i]]) = 3 


It follows from this lemma that the Poisson brackets {hi, (ho, hi}} and {hi, {ho, {ho, hi}}} are 
identically equal to 0. This is the main reason why we will have singular extremals of higher order, 
as shown in the next section. 


18 


3.3 Singular extremals 

In this section, we compute all possible optimal singular extremals arcs. Later on, we are going 
to provide sufficient conditions on the initial conditions, under which the optimal strategy of the 
problem (MTTP) does not involve (optimal) singular arcs. Before that, let us first assume that 
singular arcs do exist, and let us establish some necessary conditions along them. 

Lemma 4 . Let x{-) be a singular arc, defined on the sub-interval {ti,t2), and let (x(-),p(-),p^,u(-)) 
be an extremal lift. Then: 

• along that singular extremal, we must have (omitting t for readability) 

Pi (a — CX1X2 cosxa — (50 ~ cx\) sin 2 : 3 ) + cos 2:3 = 0, 

P2 (a — CX1X2 cos 13 — {go — cXi) sinx 3 ) + sin 13 = 0, (23) 

P3=Pi = 0, 

and 

u = — ((—0X2 + 2x1X4 — 3 cxi +go) sin 2x3 + 2cxiX2 cos 2x3 + 4 a COSX3 — 4x2X4 cos^ X3); ( 24 ) 

• p^ 0 (in other words, there is no abnormal singular extremal), and then we set p'^ = —1; 

• the four constraints ( 23 ) are functionally independent; 

• one has |M(t)| < 1, for almost every t £ (^1,^2) (in other words, any singular arc is admissi¬ 
ble); 

• u is of intrinsic order two; 

• the strengthened generalized Legendre-Clebsch condition along the singular extremal reads 

a — CX1X2 COSX3 — {go — cxi) sinx3 > 0 . ( 25 ) 


In particular, the last item of the lemma states that optimal singular arcs, if they exist, must 
live in the region of the state space defined by ( 25 ). The third item of the lemma implies that 
the singular extremals of the problem are in a submanifold of codimension 4 , i.e., the singular 
surface of (MTTP) is of codimension 4 . 

Proof. Along the interval I = (^1,^2) on which the singular arc is defined, the switching function 
(p{t) = hi{x{t),p{t)) = bp4{t) must be identically equal to zero. Differentiating with respect to 
time, we get that {/iq, ^1} = —bp3 = 0 along /. 

Differentiating again, we get {ho, {ho, hi}}-\-u{hi, {ho, /ii}} = 0 , and since the Poisson bracket 
{hi, {ho, hi}} is identically equal to 0 (see Lemma 3 ), we have {ho, {ho, hi}} = ad^ft-o-^i = 
—a6(pisinx3 — P2COSX3) = 0 along I (and the equation {hi, {ho, hi}} = 0 does not bring any 
further information). 

Differentiating again, we get {ho, {ho, {ho, ^1}}} + u{hi, {ho, {ho, /ii}}} = 0 , and there, again 
from Lemma 3 , the Poisson bracket {hi, {ho, {ho, /ii}}} is identically equal to 0 (and thus brings 
no additional information). Hence 

ad^ho.hi = —ab{x4{pi COSX3 -\- P2 sinx3) + cpiX2 sinxs — ‘icp2Xi sinx3 — 2 cpiXi COSX3) = 0 , 
which gives a new constraint. 
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Finally, a last derivation yields ad^/iQ./ii + ad^/io-^i} = 0 and since {/ii, ad^/iQ./ii} 7 ^ 0, 


we infer that 


u = -- 


ad Hq.H-i 


{hi, ad^ho./ii} ’ 

along I, and (24) is obtained. Here, we have 

nd'^ho.hi = (p,ad'‘/o./i(a;)). 


and 

{hi, ad^ho./ii} = (p, [/i,ad^/o./i](a;)) = -a 6 ^(pi cosxa +p 2 sina: 3 ). 
Hence, we have obtained the constraints 


P3=P4 = 0, Pi sin 0:3-p2 cos 0:3 = 0, 

— X4(pi cos 3:3 +P2 sin 13) + 3 cp 2 Xi sin 3:3 + cpi(2a;i cos 13 — X2 sin 13) = 0. 


They are functionally independent because diniSpan(/i, [/o, /i], [/o, [fo, [/o, /i]]) = 3 (see Lemma 
3). Moreover, using the fact that H = 0 along an extremal, we infer the relations (23). Setting 

yi = Pi (o ~ CX1X2 COSX3 — {go — cxf) sinx3) +p° COSX3, 
y2 = Pi (a — CX1X2 cosa;3 — {go — ca:i) sin3:3) +p° sina;3, 

we have rank^^^^g^j^y^ = 4 , provided that p° ^ 0 and pi ^ d, P 2 ^ 0. This implies that 

these four functions are functionally independent. If pi = 0 or p 2 = 0, then it is easy to see that 

Pi = P 2 = P° = 0, which violates the PMP. Hence pi 7 ^ 0 and p 2 7 ^ 0. If p° were to be zero, then 
it would follow from pi 7 ^ 0 and p 2 ^ 0 that y = a — CX 1 X 2 008 X 3 “ {go — cx{) sinx 3 = 0 along /. 
Differentiating, we get y = 0 and y = ac + UcPc = 0. By substituting pisinx 3 = P 2 COSX 3 into 
—X 4 (pi COSX 3 +p 2 sinx 3 ) + 3 cp 2 Xi sinx 3 + cpi( 2 xi COSX 3 — X 2 sinx 3 = 0 , we get 

2/3 = —X 4 + cxi{2 + sinxg) — CX 2 sinxg COSX 3 = 0. 


Then, setting y^ = Uc — Us = —adPc — u, we check that 1/ = 0, y = 0, 1/3 = 0 and 1/4 = 0 are 
four functionally independent constraints on the x-space. Hence, the trajectory along I becomes 
some points. To stay along I on this abnormal extremal, we need in addition u = 0 which is 
another independent constraint, and so the number of constraints has exceeded the dimension of 
the extremal (x,p)-space. Therefore p° 7 ^ 0. 

Using the numerical values of Table 1, we have 

|m| ^ + QVmt^rnax + Cvd) ^ 0.3, (26) 

and thus |u| < I. Hence, for the problem (MTTP), we have, along any singular extremal arc, 


du dt^ 


hi=Q, fc = 0,l,2,3, 


^d^h 

du dt^ ^ 


P{x,p) 


—ad{pi COSX3 +P2sinx3) d 0 : 


and then, according to Definition I, the singular solutions (which are admissible from (26)) are 
of intrinsic order two. The strengthened generalized Legendre-Clebsch condition for the problem 
(MTTP) is written here as P{x,p) < 0, and hence, using (23) and taking p^ = —I, we obtain 
(25). □ 
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Corollary 1. For the problem (MTTP), any optimal singular arc cannot he connected with a 
nontrivial bang arc. We must then have chattering, in the following sense. Let u he an optimal 
control, solution of (MTTP), and assume that u is singular on the sub-interval (^1,^2) C [0,i/] 
and is non-singular elsewhere. If ti >0 (resp., if t 2 < tf) then, for every e > 0, the control u 
switchings an infinite number of times over the time interval [ti — £,ti] (resp., on [t 2 ,t 2 +£])■ 

Proof. This result follows from Lemma 1 and Lemma 4. However, the proof is simple and we 
provide hereafterin the argument. 

It suffices to prove that the existence of an extremal consisting of the concatenation of a singular 
arc of higher order with a non-singular arc violates the PMP. The reasoning goes by contradiction. 
Assume that ti > 0 and that there exists £ > 0 such that u{t) = 1 over {ti — e,ti). By continuity 
along the singular arc, we have f{ti) = ip^^\ti) = ip^'^\ti) = ip^^\ti) = 0, and it follows from the 
strengthened generalized Legendre-Clebsch condition (3{x,p) < 0 that 

0 = ip^'^\tf) = ad^/io./ii(ti) -I- {hi,a.d^ho.hi}{ti)u{t(() 

> ad^ho.hi(ti) -I- {hi,ad^hQ.hi}{ti)u{tf) = 

and hence the switching function 11—> ip(t) = hi(x{t),p(t)) has a local maximum at t = ti and thus 
is nonnegative over (ti—e, ti), provided that £ > 0 is small enough. It follows from the maximization 
condition of the PMP that u{ti) = —1 over {ti — e,ti). This contradicts the assumption. □ 


3.4 Optimality status of chattering extremals 

In this section, we analyze the optimality status of chattering extremals in the problem (MTTP). 

Lemma 5. Assume that X 3 7r/2 -|- /ctt, fc G Z. The Hamiltonian system, consisting of (1) and 
(22), can be written as a small perturbation system, in the form (18), as 


/ 

z\ = 22, 

^2 = 23, 

< Z3 = Z4-h f 3 (z,w,u), ( 27 ) 

Z4 = ao(w) -l-uflo(w) + f4(z,w,u), 
w = F{z, w, u). 


where u G [—1,1] and 


f 3 {Gx{z),w,u) 

/4+0 A(5-3) 


= 0 , 


f4{Gx{z),W,u) 

A(5-4) 


< 00. 


( 28 ) 


by choosing new variable (z,w) as 

( 1 ) ( 2 ) ( 3 ) , 

Zi = P 4 , Z2 = pX , Z3 =p\' ,Z4=P4 + aCS\TlX3P3, 

wi = a{pi sina;3 -|-p2 cos2:3), 

\W2 = a(x4 cos 2:3 -I- ca;2 sin 2:3 — 2c2;i cos2;3)pi -I- a sin2;3(—2:4 -I- 3c2;i)p2) ( 29 ) 

W3 = P2/P1, 

W4 = Xi. 

in the neighborhood of the singular surface defined by z = 0 in the {z,w)-space. In addition, the 
strengthened generalized Legendre-Clebsch condition for system (21) yields 


W1W3 > 0 . 


( 30 ) 
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Proof. We have proved that pi 7^ 0 and P2 7^ 0 along the singular arc. Then, from ^ 12kir, 
k £ Tj we can prove that the Jacobi matrix of this variable change is of full rank by direct 
calculations, i.e., 

, . Diz, w) s 

rank!—---) = 8, 

^ D{x,p) 

After some manipulations, we can express {x,p) by the new variables {z,w) chosen in (29), as 

24 + W2 


a;i = ^4, X4 = 3cw4 — 


P3 = -Z2, Pa = zi, 


X 2 = 


w^(wi - Z 3 )' 

W1W2 — W1Z4 — W2Z3 + Z3Z4 ^ W1W2 + ^ 12:4 + W2Z3 + Z3Z4 — CW3{w4w\ — W4Z3) 


c{wi - Z3Y ' cwl{wi - 23)^ 

X3 = — 2 arctan(ii;i + 23 ± {w\w3 + wf — 2W1W3Z3 + 2wiZ3 + W3Z3 + Z3)/{w3Wi — W3Z3)), 

Pi = T\jwlwl +wl — 2 wiw1z3 + 2wiZ 3 + + z|/(2aw3), 

P2 = T\JwiW3 + Wi — 2wiw1z3 + 2wiZ3 + wlz"^ + z1l{2a). 

Although this variable transformation is not one to one in the whole (a;,p)-space, it does not 
matter, because the semi-canonical system we use is a local system and so we just need to consider 
separately the domain X3 £Vi = (— 7 r/ 2 , tt/2) and X3 £ T>2 = (—tJ", —'xl 2 ^ U (7r/2, tt). 

The manifold of singular trajectories specified by z = 0 can be written as 

S = {{x,p)\p3 = 0,p4 = 0,p2 = Pi tan 13, X4 = cxi (2 -1- sin^ X3) — 0x2 sina;3 cos 0:3}. 

Differentiating [z,w) defined in ( 29 ) with respect to time with the help of ( 1 ) and ( 22 ), we get the 
system in form. 


(32) 


with 


Zl 

= ^^2, 




Z2 

= 23, 




Z3 

= Z4 + fsix, p) 




Z 4 

= Aix,p) + B{ 

x,p)u, 


W 

\ 

= Fix,p,u), 






if Zl 

> 

0, 

- 

1 

if Zl 

< 

0, 

- 

Aix,p)/B{x,p) 

if Zl 

= 

0, 


where 

A{x,p) = {h3{x,p),Z4}, B{x,p) = {hi{x,p),Z4} = I5{x,p)/b. 

Note that here we have u = —AjB = Wg, where is given in (24). Hence we infer |w| < 1. 
By substituting (31) into (32), we can obtain f 3 {z,w), A{z,w), B{z,w) and F{z,w,u). Then we 
expand A(z,w) and B{z,w) in the vicinity of S by 


*22, r)k A 

A{z,w) = A{0,w) + 

k^l 


f)kiD 7 

B{z,w) = B{0,w) + ^ —-y{0,w) 


k=l 


k 

Id' 


By taking ao{w) = A{0,w), /3o{w) = B{0,w), system (27) is derived. We can see that system 
(27) is a small perturbation of system (18) since condition (21) holds, i.e., condition (28) holds. 
Moreover, the strengthened generalized Legendre-Clebsch condition (30) is derived from 


Poiw) = -b 


Wi{l 




2 w 3 


< 0 , 
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and (32) is transformed into a small perturbation system of form (27). 


□ 


The functions ao(w) and F{z,w,u) are different for S Vi and G I?2- However, 

we will see next that this difference does not have any influence in the demonstration of the 
optimality result of chattering extremals. 

Corollary 2. For the problem (MTTP), there exit two subbundles E’*' and E“ having the singular 
surface S as a base, and two fibers and Jf~ of dimension two filled by chattering solutions. 

Proof. It suffices to apply Lemma 5 and Proposition 1. □ 

We define S'o = S' n {iJ = 0}. Let us consider an optimal solution x(-) of (MTTP), and let us 
assume that x{-) contains a singular arc defined on (^1,^2)- Let 

M* = {x2 = 4'i(ii)}n^*(^o), 

be the submanifold where the extremals come into and out of the image of the singular surface 
7 r*(So), as shown in Figure 7. 





Figure 7: Illustration of Mf. 

In the sequel, we want to analyze the optimality status of the chattering solutions with the 
“target” submanifold Mf. The optimality status of the chattering solutions starting from the 
submanifold Mf can be analyzed similarly by considering the subbundle E“. 

We denote by Ni the lift of Mf in (a;,p)-space by associating x G Mf with the point {x,p{x)) 
that belongs to 5'o and satisfies the transversality conditional = —p2^'i(^i) (following from ( 9 )). 

Lemma 6. The submanifold Ni is Lagrangian submanifold of R® of codimension 7. Moreover, 
the function 'I'i(-) can be chosen such that the submanifold Ni is transversal to the velocity vector 
of the singular extremals in S. 

Proof. From the definition of iVi and 4, we infer that that {x,p{x)) satisfies 

cos x^ 

1 i 27 '• ’ 

a — CX 1 X 2 COSX3 — {go + cxi) sinx3 
sin 0:3 

7 i 27 '• ’ 

a — CX 1 X 2 COSX3 — {go + cxi) smx3 
P3 = 0, P4 = 0, 

X2 - 4 'i(a;i) = 0 , 

— X4 + cxi{l + sin^ X3) — CX 2 sinx3 COSX3 = 0, 

4''i(xi) tanxs + 1 = 0. 
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Then, the ^-component of the tangent vector to Ni can be written as 


Vl 


dx2 dxs 8x4 \ 
’ dxi ’ dxi ’ dxi) 


where 


8 x2 ^ dx3 . 


8 x 4 

8 x-i 


= c(2 + sin^ X3) + 


4 


( 2 x 1 (2 + sin 2 x 3 ) sin 2 x 3 — X 2 sin 4 x 3 ). 


Therefore, the 1-form w = pdx = pidxi +P2dx2 +P3dx3 +P4dx4 vanishes on every tangent vector 
to the submanifold fVi. Thus is of codimension 7 and it is Lagrangian. 

Moreover, the x-component of the velocity on the singular trajectories is 


V 2 = (ii,^ 2 ,^3, 2 ^ 4 ) = (acosx 3 — cxiX 2 ,asinx 3 -I- cxf — go,X4 — cxi,bus)^, 


with u = —a(w)/b{w). Hence, to provide transversality, it suffices to choose the function Ti such 
that vi and V 2 are not proportional, e.g., T', ^ asinx 3 +cx^-go ^ ^ 

It follows from this lemma that the submanifold N* filled by singular extremals coming into 
iVi is Lagrangian. According to Proposition 2, it suffices to prove the regularity of the projection 
TT* on using 2. 

We denote by V 3 the nonsingular velocity vector and by Vk the derivative of the projection tt* 
of 8 I 8 Z 3 . We set V = (vi,V 2 ,V 3 ,Vk)- 

Theorem 1. If the function 4'i(-) is chosen such that 


detP^^O, (33) 

then the chattering solutions of the problem (MTTP) are locally optimal in C° topology. 

Proof. On So we have 

8 \ 8x1 8 8x2 8 8x3 8 8x4 8 


diT 


823 J 823 8x1 823 8x2 823 8x3 823 8x4 ’ 


where 


8 x 1 

823 


= 0 , 


8x2 W2W3 — 2CW1W4W3 + 2 ) 1 X 2 8x3 

823 


2.1x3 


8x4 


cwfixl 


823 1x1(1-I-’ 823 IX4W3 


1 X 2 

„ 2 ,„ ’ 


and hence it follows that 

8 


I ^ 1 = ( 0, 

823 


8 


IX2W3 — 2CW1W4IX3 + 3iX2 21X3 


1 X 2 


IVl IX/3 


1 X 1(1 -I-IcI) ’ IX 3 IX 3 


Denote dir* ( 7^ ) as Vk- Using (23) and (29) we can get Vk(ix) as a vector depending on state 
\823J 

variable x, i.e. Xfc(x). 
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f d \ 

According to Lemma 2 and Remark 5, if vi, V 2 , V 3 and dir —— are linearly independent, then 

the projection is regular. In our problem, we have that the nonsingular velocity vector associated 
with It = 1 is 


^^3 = isyXA) = (a cos 0:3 — ca;iX 2 , asincca + cxI — go, X 4 — cxi, b)^. 

Therefore, if the condition (33) is satisfied on the points of A^i, then, the curve Ni has been 
chosen such that the conditions of Proposition 2 are fulfilled and so it generates the field of locally 
optimal chattering solutions in C® topology. □ 

Remark 6. The condition (33) in Theorem 1 is always satisfied if one chooses an appropriate 
function 4'i(')- Indeed, we have 

4 

detR = 

i=l 

where Di^i is the (t, 1) minor. Some calculations show that D^ i = 0, and hence (33) becomes 
det V = Di^i — '^[ 02,1 — ^ 0. It suffices to ensure that Di,i, i = I, 2,3, do not vanish 

simultaneously. We prove this fact by contradiction: otherwise, it is easy to check that they yield 
three independent constraints in the a;-space, and moreover, they are independent of the constraints 
2/3 = 0 and X 2 = ^'( 2 : 1 ) for the singular surface S. In this case, the number of constraints is larger 
than the dimension of the a:-space. Therefore, Di i, i = 1, 2, 3 do not vanish simultaneously. 

4 Chattering prediction 

Since the chattering phenomenon causes deep difficulties for practical implementation, due to the 
fact that an infinite number of control switchings within finite time cannot be realized in real-life 
control strategies, in this section our objective is to provide precise conditions under which we can 
predict that an optimal singular arc does not appear, and thus there is no chattering arcs. 

A maneuver with 7 / ^ 70 (resp., 7 / < 70 ) is said to be a anticlockwise maneuver (resp., a 
clockwise maneuver). In practice, the values of X 30 and x^f are chosen in ( 0 , 7 r/ 2 ), and the values 
of 7 o, 2:40 are chosen such that I 70 — 2 : 30 ] ^ 0.1 and |x 4 o| ^ 0 . 1 . 

We distinguish between those two maneuvers because of the gravity force imposed to the 
spacecraft. We will see further, in the numerical results, that the clockwise maneuver is easier 
to perform than the anticlockwise maneuver, in the sense that the clockwise maneuver time is 
shorter (in time), and there is less possibility of encountering a singular arc. This fact is due to the 
nonlinear effects caused by the gravity force. Indeed, intuitively, the gravity force tends to reduce 
the value of 2 : 2 , and hence the value of tan 7 = X 2 IX 1 tends to get smaller. Then the spacecraft 
velocity turns naturally to the ground (pitch down) under the effect of the gravity. This tendency 
helps the clockwise maneuver to be “easier”. 

Although we have set c = 10“® (see Table 1), we have c ^ 10“® in real-life, since c = l/r where 
r is a distance not less than the radius of the Earth. The case c = 0 corresponds to a flat-Earth 
case, and the case c S ( 0 , 10 “®] will be referred to as the non-flat case. 

4.1 Flat-Earth case c = 0 

We can see from (4) that 7 is much smaller than X 3 and 2:4 given by (2). Therefore, the main factor 
that affects the total maneuver time is the time to change 7 from 7 ( 0 ) = 70 to 7 (t/) = 7 / = 2 : 3 /. 
In order to shorten the maneuver time, it is required to keep 7 as large as possible. 


25 


To this aim, we consider the time minimum control problem in which X3 is seen as a control. 
We call this problem the problem of order zero, i.e., 


mint^ s.t. 

Xi = acosxa, ±2 = asinxa — go) 

xi(0) = Vo COS70, X2(0) = xo sin7o, X2(t/) - Xi(t/) tan7/= 0, 

The optimal solution of this problem is easy to compute (explicitly) with the PMP. The optimal 
control on [0,tf] is given by 


xsit) = X3 = 

and the maneuver time is 


= 


7/ + 7 r/ 2 , if X20 COS7/ < xio sin 7/, 
- '^/ 2 , if a; 2 o COS7/ > xio sin 7/, 

(xio tan7/ -X2o)cos7/ 


(34) 


asin(x^ - Jf) - go cos 7/ ’ 
Moreover, the adjoint vector is given by 

nO 


{pi,P2) = (sin7/,-cos7/) 




a sin(x5 - If) - go cos 7/ ’ 


Remark 7. From this expression, we see that go makes the anticlockwise maneuver slower, i.e., 
^ clockwise maneuver faster, i.e., tf ^ 

fore, the clockwise maneuver is “easier” to perform than the anticlockwise maneuver thanks to the 
gravity, which corresponds to intuition, as saif at the beginning of this section. 

Turning back to the problem (MTTP) in the flat-Earth case, from Lemma 4, the singular 
surface is given by 


S = {{x,p) \ X3 = xl, X4 = 0 , Pi =-p° cosxl/{a-gosinxl), 

P2 =-p° smxy{a - gosinxl), P3 = 0, P4 = 0}. 

It is interesting to see that the solution of the problem of order zero coincides with the singular 
solution of problem (MTTP) in the flat-Earth case. We have the following results. 

Lemma 7. Let x(-) be an optimal solution of (MTTP) in the flat-Earth case, associated with 
the control u. If x{-) contains at most one point of S2 = {(x,p)|x3 = Xg}, then the control u is 
bang-bang and switches at most two times. 

Proof. If m(-) is singular, then (x(-),p(-)) is contained in 5” C 82. From the definition of S, it is 
easy to prove that x(ti) ^ x(t2) for any ti t2 in [0,t/], which means that (x(ti),p(<i)) and 
{x(t2),p{t2)) are two different points of 82. This contradicts the condition that x(-) contains at 
most one point of 82. Therefore, u(-) is bang-bang. 

It suffices to prove that if x(') contains at most one point of 82, then (p{t), t G [0,t/], remains 
of constant sign and has at most one zero. Indeed, if this is true, then (p(t) = —p3(t) is monotone, 
and it follows that the first derivative of the switching function Lp(t) has at most two zeros, which 
means that the control u has at most two switchings. Let us prove this fact by contradiction. 
If there exists ti G [0,t/] such that {x{ti),p{ti)) G 82, using pi tan7/p2 = 0 (transversality 
condition) and pi,P2 0, we have 

(p(ti) = -poiti) = -a(pisinx3 -P2COSX3) = ap2 cos(x3 -7/)/COS7/ = 0. 
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From the continuity of we get that there exist two times Ti < ti and tj > ti such that 
(fi{Ti)(p{Tj) < 0 . It follows that a;3(ti) and Xz{t2) are on different sides of Xg = 7/ ± 7r/2, i.e., 
— x^){x3{t2) — Xg) < 0 . However, we know that xgo and Xg/ = 7/ are on the same side of 
Xg, i.e., (xgo — X3)(x3/ — Xg) < 0 , and hence there must exist another time ^2 at which <^(^2) = 0 
{{x{t2),p{t2)) £ S2) in order to allow the trajectory to reach the terminal submanifold. This is a 
contradiction. □ 


We denote a bang arc with u = 1 (resp. u = — 1 ) as (resp. A-), and we denote a chattering 
arc and a singular arc by Ac and Hg, respectively. Let be the union of all trajectories x(-) 
consisting of three different bang arcs satisfying the terminal conditions x( 0 ) = xq and x^itf) = X3/, 
Xiitf) = 0 . These trajectories are of the form A+A-A+ or A-A+A-. Easy calculations show that 
the optimal control u{t) and the trajectory x{t) of the form A+A-A+ (resp. A-A+A-) are given 

by 

r+l,t e [0,ri), (resp.,-1) 

u{t) = <1 g [ri,r2) U [t2 ,T3), (resp.,+ 1 ) 

[+l,t e [r3,t/], (resp.,-1) 

and 


with 


xi(t) = uq cos7o + / acosx3(s)(is, 

Jo 

X2(t) = vosinjo + / asinx3{s) — gods, 

Jo 


'xgo+X 4 ot + t€[0,ri), (resp.,Xgo-X 4 ot-&t^/ 2 ,) 

a^3('ri) + (a;40 + bTi){t - n) - b{t - ri)2/2, t G [n, r 2 ), 

X (t] = < ("^^^'P-^^3in)-ix4o + bTi){t-Ti)+b{t-Ti)'^/2,) 

X3-b{t-T2Y/2, t£[T 2 ,T 3 ), (resp.,X 3 + 6(t-T2)^/2,) 

X3{T3,)-b{T3-T2){t-T3)+b(t-T3f/2, t£ [T3,tf], 

^ (resp., X 3 (r 3 ) + ^(rg - T 2 )(t - rg) - b{t - Tof 12 ,) 

{ X 40 + W, t G [0,Ti), (resp.,X40 - ) 

2^40 + bri - b{t - Ti), t G [ri, T 2 ), (resp., X 40 - bri + b{t - ti), ) 
-b{t - T 2 ), t G [r 2 ,T 3 ), (resp. b(t - T 2 ),) 

-b{T 3 - T 2 ) + b{t - Tg), t G [rg, tf], (resp., ^(Tg - T 2 ) - b(t - Tg), ) 


n = 


X40 


^40 2^30 X3 


2&2 


O I 

T2 = 2 ti + —, T3 = T2 
0 


XSf - Xs 


( 35 ) 


tf = 2 t3 - T2, 


(^resp.,Ti 


X40 


-^40 

262 


2:30 - X3 


O I ^^0 

T2 = 2 ri + 

b 


T 3 = T2 


X3f - X3 


tf = 2 t 3 - T 2 ,^ 


where xg is the maximal (resp., minimal) value of X3{t), t G [ 0 ,</]. Besides, by integration, we 
have 

pt pi. 

PoiJ) = Poi^) + / a(pisinx3(T) -P2C0SX3(t)) dr =713(0)- — / cos{x 3{t) - ^f) dr, 

Jo cos 7 / Jo 
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and ^ 

P4{t) = P4{0) - P3{0)t + [ [ cos{x3{t)- jf)dTds. ( 36 ) 

cos 7 / Jo Jo 

Using P4{ti) = ^4(7-3) = 0 , we get 

P3(0) = 7- ^ - ([ [ cos{x3{t) --ff) dr ds - [ [ cos(a;3(r) - 7/) dr dsV ( 37 ) 

(73 ~ 7"!) cos 7/ \Jq Jq Jq Jq J 

and 


P4{Q) =—-j [ cos(a;3(r)-7/)dT 

COS7/V(t3 -n) 7 o Jo 


ds 

7-3 


(r3 - ri) 


J J cos{x3{t) — jf) dr ds^ . ( 38 ) 


From H{ 0 ) = 0 and using the transversality condition, we infer pi and P2 as functions of X3 
provided ^ 0 . Actually, is indeed nonzero, otherwise, using 77 ( 0 ) = 0 , the transversality 
condition and equations ( 37 ) and ( 38 ), we would infer that p = 0 , which is absurd. We see that, 
if moreover X2(tf) = a;i(t/) tanxs/, then the trajectories x(t) in together with p(t) satisfy all 
necessary conditions of the PMP. 

The value a;3 can be numerically derived from the condition X2{tf) = xi{tf)taiiX3f, and then 

{x{t),p(t)) is obtained. In fact, for given terminal conditions a::( 0 ) = xq, X3(tf) = X3/ and X4(tf) = 

0 , J^X3 can be seen as a one-parameter family of trajectories with parameter a;3. Hence, for any 

2 

given ^3 e (max(x3o,a:3/),a;3] (resp., X3 G [ig,min(x3o,0:3/))) with X30 = X30 - ^signa;4o, we 
have 

7/(^3) = l{tf{x3)) = arctaiix2itf{x3))/xi{tf{x3)). ( 39 ) 

If we have 

dlfjxs) _l( dx 2 itf{x 3 )) _ dxi{tf{x 3 )) 

dx 3 V V dx 3 dx 3 

f 

{a{Ti sin(S3 - 7/) -f t/ cos(x3 - 7/)) - goTi COS7/) dt ( 40 ) 

+ tj sin(x3 - 7/ + <d) - 507 "! cos 7/^ dt > 0, 

where 


Vf = y xi{tf{x3)y + X2{tf{x3)y, ip = arctan 
T 1 , 1 

\/(^3 - X 3 o)/b + x%/{2by y{x 3 -Jf)/b’ 

for all x(t) in then we have that 7/(a;3) is monotone with a;3. Therefore, the value of "ff{x3) 
reaches its maximum (resp., minimum) when X3 = Xg. In this sense, we have a reachable set of 7/ 
as a function of X3. 



^ 7 / 7 / 


Vftf 



Remark 8. In the anticlockwise case, the trajectories generally take the form of A+A_A+. How¬ 
ever, if the condition ( 40 ) is valid, 7/(x3) achieves a minimum extremal value over [max(x3o, X3/), Xg] 
when Xg = max(x3o,xg/). Then, if 7/ < 7/(x3/), the trajectory takes the form A_A+A_. 
There exists a Xg = xg G [xg, min(x3o, xg/)) such that 7/(xg) = 70. Hence, xg takes value in 
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= (max(a;3o, cca/), ccg] U [ig, min(a:3o, xg/)) for anticlockwise maneuvers. For the clockwise 
maneuvers, we have that X3 takes value in = (max(a;3o, xg/),ig] U [x|, min(x3o, Xg/)) where 
xg € (max(x3o, xg/),Xg] being the extremal value such that 7/(^3) = 7o- 

The positivity condition ( 40 ) is hard to check explicitly, however, numerically this condition 
can be verified easily for given terminal conditions. This is why we take it as an assumption. 
Accordingly, we make the following assumptions throughout this section. The first assumption is 
that Ti, T2, Tg and tf are nonnegative real numbers. The second assumption is that ( 40 ) holds. The 
third one is that the spacecraft would not crash after the maneuver. The results of our numerical 
simulations are consistent with these assumptions: 

• the real numbers xgo, X40, xg/ are chosen such that ti ^ 0 , T2 ^ 0 , Tg ^ 0 and tf > 0 ; 

2 

• for every Xg S (max(x3o, xg/), Xg] (resp., xg G [xg, min(x3o, xg/))) with xgo = X3o-^signx4o, 
we have 



7/ + (f)dt > 


gptf cos 7/ 


• Xi(t/) > 0 , X2{tf) > 0 . 

Under these assumptions, we have the following chattering prediction result. 

Theorem 2 (Chattering prediction). Let x(-) G be an optimal trajectory of (MTTP) in the 
flat-Earth case. In the anticlockwise case (resp., in the clockwise case), if 

{resp., if Sc < 0), (41) 

with Sc defined by 

Sc = X 2 {tf{x* 3 )) -Xi(t/(x 3 ))tan 7 /, (42) 

where xi{tf{xl)) = xio + a cos X3{t) dt, X2itf{xp)) = X20 + sin X3{t) — go) dt, and 

xo{t) is calculated from ( 35 ) with xg = Xg, then x(-) does not involve any singular arc. 

Proof. In the conterclockwise case, if Sc ^ 0 , then we get from ( 39 ) and ( 42 ) that tan7/(x3) ^ 
tan7/ provided that xi(t/) > 0 and that X2{tf) > 0 . Using that 7/ = xg/ G Vf, it follows that 
(7/(^3) ~ 70) ^ (7/ ~ 7 o)- Since d^f{xo)/dxo > 0 , we infer from the implicit function theorem 
that there exists a xg = X{'^f) G where X{-) is function, such that ')f{xo) ^ Jfixs) and 
that the corresponding trajectory x{t) is an optimal trajectory for (MTTP) with terminal value 
of 7 /(x 3). The proof is similar in the clockwise case. □ 

Remark 9 . If ( 41 ) is not satisfied, then there are two possible types of solutions: one has more 
bang arcs, the other has a singular arc with chattering arcs around the singular junctions. The 
points of S2 actually correspond to the zeros of the second-order time derivative of the switching 
function (zg = 0 in the semi-canonical form), and so the zeros of S2 will impose an immediate effect 
on the switching function, but ensure the switching function to have more possible switchings. The 
numerical results show that the additional bang arcs lead to extremals that are closer to the singular 
surface with an exponential speed. 
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4.2 Non-flat case c > 0 


If c > 0 then the analysis of the problem (MTTP) becomes more complicated, but we are able as 
well to describe the set of initial data for which optimal trajectories do not have any singular arc, 
as we will see next. 

We assume that the condition ( 40 ) still holds, i.e., > 0 , and the real numbers x^q, 140, 

Xsf are chosen such that ti ^ 0 , T2 ^ 0 , T3 >0 and tj > 0 . Assume moreover that the real 
numbers vq and 70 are chosen such that the two components of the velocity are positive along the 
whole trajectory, i.e., xi{t) > 0 , X2{t) > 0 , t G [ 0 ,t/]. Using Table 1 , we have 

xi{t) G [acosxa — acosxa], 

X2{t) G [asinxa - go, a sin0:3 - go + 

X3{t) G [ 0:4 - CVmax,X4], 

where « (iio + aT)^ + (a;2o + aT + a‘^cT^/ 3 )'^ < v^. It can be seen that the terms in c in the 
dynamics cause a decrease of Xi and X3, and an increase of X2- We consider the auxiliary problem 

{ min tf 

xi = acosxs — C1X1X2, i:2 = nsinio — go + cia;4, X3 = X4 — cVmax, Xi = bu, 

x{ 0 )=Xo, X3{tf)=X3f, X4{tf)=0, 

where c, Ci G [ 0 , 10 “®]. Similarly to the flat-Earth case, the solutions of this problem, of the form 
A+A_A+ (resp., A_A^A_), can be obtained by integrating the dynamical system, by using the 
control 

r+I,t G [ 0 ,fi), (resp.,-I) 
u{t) = < -I,t G [fi,f2) U [f2,f3), (resp.,+ 1 ) 

[+l,f G [h3,f/], (resp.,- 1 ) 

with 


Tl = 


(X 40 CVmax) / (^40 CVjnax^^ ^30 ^3 


262 


, T2 = 2 ti 


(X40 - cv max ) 


T 3 = T2 


( ^ 3 / ^3 

262 5 ^ 


tf = 2 t 3 --- T2. 


^ resp., Ti= — 


(X40 CVmax} , ^ / (^^40 CVmax')‘^ ^30 ^3 

262 + 5 


, h = 2 ti 


(x 4 o - cv max ) 


T 3 = T2 


( CVmax}^ ^ 3 / ^3 

+ -T-, U = ^'3 


262 


r rt CVmax ^ 

tf = 2 t3 -;-T 2 , 


Let 7 /(^ 3 , c. Cl) = min ( 7 (f/(a; 3 ), c > 0,ci = 0), 7 (t/(x 3 ), c > 0,ci > 0)) for this problem. Based 
on the numerical results, we make the following assumptions: 

• 7 /( 2 ^ 3 ,c, Cl) ^ = 1 f (tf T c = 0 , Cl = 0 ) in the anticlockwise maneuvers; 

• 7 /( 2 ^ 3 ,c, Cl) ^ 77 ( 2 : 3 ) = jf {tf (x'^), c = 0 , Cl = 0 ) in the clockwise maneuvers; 

Under these assumptions, we have the following result. 

Corollary 3. Let x{-) be an optimal trajectory of (MTTP) in the non-flat case. Then: 


30 





















• for an anticlockwise maneuver, if ( 41 ) holds true then a;(-) does not have any singular arc; 

• for a clockwise maneuver, if 

Sc = X 2 iif{xl),c,ci) - xi{if{xl),c,ci)ta.iijf < 0, 

where X2(tf{x'^), c, ci)/xi(tf{x^),c, ci) = tan^f{x^,c, ci), then x(-) does not have any singu¬ 
lar arc. 

Proof. For an anticlockwise maneuver (resp. a clockwise maneuver), we have that if Sc ^ 0 
(resp. Sc ^ 0), then 0^7/^ < jf{xl,c,ci), (resp., 0^7/^ jf{xl,c,ci)), and thus 

there exists a xs = X{-ff) such that {^f{xz,c > 0 , ci > 0 ) — 70) ^ (jf{x’^,c,ci) — 70), (resp., 
(7/(2;3)C > 0 ,ci > 0 ) — 7o) ^ (7/(^3, c, Cl) — 70)), and its associated trajectory is an optimal 
solution of the problem (MTTP). □ 

Remark 10. Similarly to Remark 9 , in the non-flat case, numerical results show that if the 
conditions in Corollary 3 are not satisfied, then the trajectories will have more bang arcs until the 
singular arc finally appear with chattering type junctions. 


5 Numerical Results 

In this section, we compute numerical optimal strategies, for different initial conditions, either by 
means of a direct method, or by means of an indirect one (shooting method). It is important 
to note that, if the optimal trajectory involves a singular arc and thus has chattering, then the 
shooting method fails in general. Indeed, the infinite number of switchings may cause a failure 
in the numerical integration of the dynamical system, and then direct methods may therefore be 
more appropriate to approach chattering. However, since they are based on a discretization, they 
can only provide a sub-optimal solution of the problem, having a finite number of switchings. 

In the first subsection, we provide several numerical simulations, where the optimal solutions 
are computed by means of a shooting method, in situations where the optimal trajectory is known 
to be bang-bang, without any singular arc, and with a finite number of switchings. 

In the second subsection, we describe in more details sub-optimal strategies, and we provide 
evidence of their relevance in cases where we have chattering. 

In our numerical simulations, we consider the initial and final conditions settled in Table 2 . 



X30 

X40 

a;io 

X20 

X 3 f 

X40 

X2f — xi/tan 0:3/ 

Counter-clockwise 

1.3 

0.0 

Vo cos X30 

Vo sin X30 

1.5 

0.0 

0.0 

Clockwise 

1.5 

0.0 

Vq cos X30 

vo sin X30 

1.3 

0.0 

0.0 

Vo = {xio + xioV^'^ 


Table 2 : Initial and final conditions. 

Here, we set 7(0) = 70 = x^q, meaning that before the maneuver the spacecraft was on a 
trajectory with angle of attack equal to zero. 

Recall that when the optimal trajectory contains a singular arc, then the extremal is normal, 
i.e. 7^ 0 (see Lemma 4 ). Moreover, in the flat-Earth case, we have seen from the analysis 
in Section 4.1 that the bang-bang extremals are normal in case of two control switchings. The 
argument was based on equations ( 37 ) and ( 38 ). Furthermore, it is not difficult to see that if the 
control switches at least two times, then the extremals are normal. Therefore, abnormal extremals 
may only occur whenever the control switches at most one time. 
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In the non-flat case, since c > 0 is very small, we can assume that < 0 though the abnormal 
extremals may also exist with a few certain terminal conditions. Thus, the adjoint vector can 
be normalized by = — 1 . The results of the numerical simulations are consistent with this 
assumption. 

5.1 Chattering prediction 

In practice, the terminal condition that can take very different values is the initial modulus of 
velocity vq. Hence, we next investigate the influence of vq on the occurrence of optimal singular 
arcs. 

Flat-Earth case with two switchings. If we consider vq as variable and if we take c = 0, 
then, by solving Sc = 0, we get Vup = vq = 1086.2 m/s (resp., Vdown = vo = 1694.3 m/s) for 
anticlockwise maneuvers (resp., for clockwise maneuvers). When vq ^ Vup (resp., vq ^ Vdown), we 
have Sc ^ 0 for anticlockwise maneuvers (resp.. Sc ^ 0 for clockwise maneuvers). In this case, 
according to Theorem 2, there is no singular arc in the optimal solution. Moreover, the maneuver 
times for both maneuvers are the same, i.e., tf = 36.5437 s. 

Using an indirect method (shooting method), we compute the optimal solutions of the problem 
(MTTP), in the absence of a singular arc. Recall that the indirect method does not work when 
there are chattering arcs. From the prediction above, we should therefore be able to use successfully 
an indirect method when vq ^ u„p. We will see in numerical simulations that the indirect method 
works when the trajectory consists of three bang arcs, but fails otherwise due to chattering. 

Figure 8 provides the solutions for two different values of the initial velocity modulus vq for the 
anticlockwise case, i.e., vq = Vup = 1086.2 m/s (plotted in solid lines) and vq = 1080 m/s (plotted in 
dashed lines). Figure 9 shows the solutions of clockwise maneuvers with vq = Vdown = 1694 . 3 m/s 
(plotted in solid lines) and vq = 1690 m/s (plotted in dashed lines). The red star points represent 
the touching point of the trajectories with the surface S2 (where 0:3 (t) touches 0:3). It is shown in 
Figure 8 that there is no singular arc in the trajectories when vq < Vup (resp., in Figure 9 when 
Vo < Vdown)- The control switchings two times and the 0:3 associated with the dashed line is smaller 
than = 2:3/ -I- tt /2 (resp. bigger than = x^f — tt/ 2 ). 




Figure 8: Time history of 2:3, 2:4 and u when vg = Vup and vq = 1080 m/s 

In Remark 9 , we mentioned that, when the condition ( 41 ) is not satisfied, there are more bang 
arcs until the appearance of a singular arc. We will show next the solutions with more switchings. 
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Figure 9 : Time history of 3:3, Xi and u when vq = Vdown and vq = 1690 m/s 


As remarked, these results will show that the extremals will get closer to the singular surface S 
when more bang arcs are present. 


Flat-Earth case with more switchings. In fact, we can compute the corresponding value of 
Vq for optimal controls with different number of switchings, in the following way. Let us assume 
that the optimal control u has 2 m, m = 1 , ■ ■ ■ ^ N switchings and u( 0 ) = uq being +1 or — 1 , i.e.. 


Uo, 

t e 

[To,n], 

-Uq, 

t e 

[T4j-3,T4j-l], 

Uo, 

t € 

[x4j-l,X4j-\-i\, 

-Uo, 

t € 

["^4771 —3? "^4777—1 

Uo, 

t € 

[’^4777 — 1 , "^ 4777 ] , 


with j = I,-- - ,(m - 1), to = To, tf = Tim, then we know that ip{T 2 k^i) = Pi{T 2 k+i) = 0, 
k = Q, - ■ ■ , 2m — 1 . Here we have additionally hi{T 2 m) = Pi{T 2 m) = 0 , because the maximum vo 
corresponding to 2m switchings happens when u is about to have one more switchings between 
'^2m — l and T2m+1- 

Let g = (x3(T2k))/,_^ 2m-i variable vector (of dimension 2 m — 1 ). On Figure 10 are 

represented P4(t), psit), Xi{t) and xoit) for an anticlockwise maneuver with m = 3 , the variable 
<7 = (911 • • ■ ) 95) is of dimension 2m — 1. 

Using ( 36 ), we derive 2 m — 1 constraints on q without the adjoint vector p, i.e., 

Tk^ - Tk^ ^ cos(x3(s} - 7/) dsdT - cos(x3(s) - Jf) dsdT 

Tks - Tk4 fj cos(a:3 (s) -jf)dsdT- fj cos(a;3 (s) -jf)dsdT’ 

where ki,k2,k3, ki S { 2 A: + 1 | fc = 0 , • • • , 2 m — 1 } U { 2 m} and fci 7^ k2, ko ^ ki. Note that at least 
one of these equations must involve T2m- 

Since X3{T2k), fc = 1 , • • • , 2 m — 1 are local extrema, we must have Xi{T2k) = 0 , A: = 1 , • • • , 2 m— 1 . 
By integrating the system from a;( 0 ) = xo and requiring that 


X4{T2k) = 0, fc = I,--- ,2m-l, 
X3{T2k) = q, k = I,-■ ■ ,2m - 1, 

X 3 {tf)=X 3 f, X4{tf)=0, 
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Figure 10: Example of trajectory associated with optimal control of 6 switchings. 


we can parametrize the fc = 1, • • • , 4m by g, and hence as well the trajectories Xslt) and Xi{t) 
which are parametrized by rt, fc = 1, • • • , 4m. More precisely, we have 


Tl = 


X 40 

b 


^40 : I'?(1)-2;3oI 


262 


T2 = Tl 


2^40 , ^(l)-2^301 


262 


T2fc+1 — T2k + 


\q[k) - q{k + 1)1 


T2fe+2 — T2fc+1 + 


\q{k) - q{k + 1 )| 


fc = 1 , • • • , 2 m — 2 , 


— I — '^Am—2 



- 1) -T 3 /I 

6 


'^Am. — ^4m—1 



- 1) -2^3/1 
6 


Hence, we can get the value of q by solving (43). Then taking uq as variable and 7 (f/) = 7 / as 
shooting function, we can derive the maximum vq that can be used when we expect the control to 
have 2 m — 1 switchings. 

Using this method, we get that, in the anticlockwise case, when vq € (uup, 1183.4] m/s, the con¬ 
trol u{t) has two switchings. When vq € (1183.4,1999.3] m/s, the control u{t) has four switchings. 
Then when vq G (1999.3, 2132.1] m/s, the control u(t) has six switchings. 



Figure 11: Switching function (p(t) when vq = 1999.3 m/s in the anticlockwise case. 
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Figures 11 and 12 give the time history of the switching function ip(t) = hi(t) when vq = 
1999.3 m/s and vq = 2132.1 m/s, respectively. Observing from the zoom-in windows of the figures, 
we see that the switching function is almost equal to zero when t G [22, 26] s and t G [22, 28] s. 
This implies that the associated extremals are very close to the singular surface S along these time 
intervals. These figures also show that the additional bang arcs lead rapidly the extremals to get 
closer to the singular surface S (see Remark 9). 



Figure 12: Switching function ip{t) when vq = 2132.1 m/s in the anticlockwise case. 

Note that when u(t) has 2m switchings, the trajectory of X 3 (t) has between max(0,2m — 2) 
and 2m contact points with the surface S' 2 - Figure 13 shows the comparison of solutions with 
Vq = 1350m/s (solid line) and vg = 1683 m/s (dashed line). They both belong to the four 
switchings case, i.e., m = 2. We can see that the solid line touches the surface S 2 two times, while 
the dashed line touches four times. 




Figure 13: Time history of xg, X 4 and u when vq = 1350m/s and vq = 1683m/s 


Non-flat case. When c > 0, according to Corollary 3, there does not exist any singular arc for 
anticlockwise maneuvers when vq ^ Vup- For clockwise maneuvers, if vg ^ Vdown = 1624.3 m/s, 
then there is no singular arc (this condition is obtained by solving Sc = 0 with c = 0 and 
Cl = 10“®). The assumptions are also verified. 
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In Figure 14, setting uq = Vup, we compare in anticlockwise case the solution with c > 0 (plotted 
with solid line) and the solution with c = 0 (plotted with dashed line). The trajectory X 3 {t) in the 
Hat-Earth case in fact reaches the surface S 2 in smaller time than in the non-flat case. 




Figure 14: Time history of X 3 , X 4 and u when c = 0, c = 10 ® and vq = Vup 

Let Vq = Vdown = 1624.3 to/s. Figure 15 gives a comparison in the clockwise cases of the 
solution with c > 0 (plotted with solid lines) and the solution with c = 0 (plotted with dashed 
lines). Both trajectories do not touch the surface S 2 and the trajectory in the non-flat case gets 
“closer” to 82 - The control switchings two times and there is no singular arc. 




Figure 15: Time history of 0 : 3 , X 4 and u when c = 0 and c = 10 ® 

In other simulations, we also observe that when vq < Vdown, the optimal control only has two 
switchings and X 3 will not reach to However, when uq > Vdown, new bang arcs appear and the 
trajectory tends to have chattering arcs. These results illustrate Corollary 3 and Remark 10. 


5.2 Sub-optimal strategies 

Let TV be a positive integer. We consider a subdivision 0 = tg ^ ^ ^ tpf = tf ot the interval 

[ 0 ,t/] (where ti are unknown), and we consider piecewise constant controls over this subdivision. 
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thus enforcing the control to switch at most N times. We consider the optimal control problem 
(MTTP) with this restricted class of controls, that we denote by (MTTP)^. 

Solving this problem provides what we call a sub-optimal strategy (with at most N switchings), 
because the optimal value of (MTTP)^ must be less than or equal to the optimal value of 

(MTTP). 

By the way, we expect that, (MTTP)^^ F-converges to (MTTP) as N ^ +oo, meaning that, 
in particular, the optimal value of (MTTP)^^ converges to that of (MTTP). We will come back 
on this issue later. 

As in classical direct methods in optimal control, we propose to solve numerically the problem 
(MTTP)jy, where the unknowns are the nodes ti of the subdivision, and the values Ui of the 
control over each interval (ti,ti^i). More conveniently, instead of considering the switching times 
ti as unknowns, we consider the durations — ti as unknowns. Note that these durations may 
be equal to 0. 

The control is kept constant along each interval of the subdivision, but in order to discretize 
the state in a finer way, we consider another (much) finer subdivision to compute the discretized 
state. 

We solve the resulting optimization problem by using IPOPT (see [45]) combined with the 
modeling language AMPL (see [16]). 

Numerical results for anticlockwise maneuvers. We consider first the case of anticlockwise 
maneuvers. Let vq = 3000 m/s. For N = 500, the numerical optimal solution of (MTTP)^ is 
provided on Figures 16 and 17. This simulation provides numerical evidence of the fact that we 
have a singular arc for t G [25.7, 28.1] s, with a chattering phenomenon at the junction points with 
the singular arc (see Figure 16, on the right, where a zoom is made on those points). The singular 
control takes values in [—0.0016, —0.0013]. 

Moreover, the coordinates x^it) and Xi{t) oscillate around x^ = X 3 and X 4 = 0 respectively, 
and the coordinates a:i(t) and X 2 (t) oscillate around a straight line in the vicinity of the singular 
arc of the flat-Earth case. This indicates that the singular arc of the non-flat case does not vary 
much from that of the flat-Earth case. 



Figure 16: Control u(t) in anticlockwise maneuver 


Numerical results for clockwise maneuvers. For clockwise maneuvers, still taking N = 500, 
the numerical optimal solution of (MTTP)^^ is provided on Figures 18 and 19. By comparing the 
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Figure 17: State variable x{t) in anticlockwise maneuver. 


clockwise maneuver in Figure 18 and 19 and the anticlockwise maneuver in Figure 16 and 17, we 
see that, when 0 : 4 ( 0 ) = 0, to realise the same I 7 / — 70 I, one need 62.43 s for the anticlockwise case 
and only 59.26 s for the clockwise case. 



t: s 



Figure 18: Optimal control in clockwise maneuver. 


F-convergence of (MTTP)^^ to-wards (MTTP). It seems natural to expect that, if ^ +00, 
then the solution of (MTTP)^ converges to the solution (if it is unique) of (MTTP). At least, 
F-convergence is expected. Such an analysis is beyond the scope of the present paper, however it 
is interesting to provide numerical simulations, for an anticlockwise maneuver, with several values 
of A^: 

N e {6,8,10,12,14,16,18,20,30,40,50,100,200,300,400}. 


Figure 20 provides the numerical optimal control obtained for (MTTP)^^. We observe that, when 
N becomes larger, then the optimal control seems to converge to its expected limit, that is the 
optimal control of (MTTP) with a singular arc and chattering. On Figure 21, we have reported the 
values of the maneuver time, in function of N. We observe that they seem decrease exponentially 
with respect to N. This numerical observation is important because, in practice, this means that it 
is not necessary to take N too large. Even with quite small values of N, the minimal time obtained 
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t: s t: s 


Figure 19: State x{t) in clockwise maneuver. 


for (MTTP)^ seems to be very close to the minimal time for (MTTP). Hence the sub-optimal 
strategy seems to be a very good solution in practice, to bypass the problems due to chattering. 
We conclude with the following conjecture. 

Conjecture. With obvious notations, we denote by {x^{■), {■), ) the optimal solution of 

(MTTP)jy, and by {x{-),u{-),tf) the optimal solution of (MTTP) (assuming that they are 
unique). Then —>• tf exponentially, x^{■) —>■ a;(-) in C^-topology, and {■) —>■ u{-) in L^- 

topology, as iV —-foo. 

Remark 11. Such convergence properties have been established in [20, 37], but for problems not 
involving any singular arc. Here, the difficulty of establishing such a result (in particular, for the 
control) is in the presence of an optimal singular arc. 

Remark 12. These simulations were done by using hot-restart, that is, by using the solution of 
the problem (MTTP)^ to initialize the problem with a larger value of N. 
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